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Abstract 

This paper studies the three-user finite field multi-way relay channel with correlated sources, where three users exchange 
possibly correlated messages via a relay. Full data exchange is considered where each user is to decode the messages from the 
other two users. There is no direct link among the users; the uplink from the users to the relay and the downlinks from the relay to 
the users are finite field adder channels with independent additive noise of arbitrary distributions. The problem is to determine the 
set of all achievable rates, defined as channel uses per source symbol for reliable communication. Using the Slepian-Wolf source 
coding and a functional-decode-forward channel coding scheme, the solution is obtained for two classes of source and channel 
combinations. Furthermore, for correlated sources with common cores, two new functional-decode-forward coding schemes are 
constructed and are shown to obtain the set of all achievable rates for any source and channel combination. 

I. Introduction 

In this paper we study the three-user multi-way relay channel (MWRC) with correlated sources, where each user is to 
transmit its data to the other two users reliably (in the Shannon sense) via a single relay, and where the users' messages can 
be correlated. Correlated sources are commonly found in multiple geographically disttibuted measurements of the same type, 
e.g., temperature. One application of the MWRC with correlated sources is communication via a satellite (T). 

The MWRC is a canonical extension of the extensively studied two-way relay channel (TWRC), where two users exchange 
data via a relay |2)-||7]. Adding additional users to the TWRC can change the problem significantly (8)-fT0). The MWRC has 
been studied from the point of view of channel coding and source coding under different setups. 

In channel coding setups, the sources are assumed to be independent, and the channel noisy. The problem formulation is 
"how many bits of data can each user send per channel use?" Achievable rate tuples here refer to the tuple of the number of 
message bits (per channel use) the users can transmit such that all other users can reliably recover their intended messages. 
The challenge is to find the capacity region which is the closure of all achievable rate tuples. For the Gaussian MWRC with 
independent sources, Giinduz et al. |9| obtained asymptotic capacity results for the high SNR and the low SNR regimes. 
For the binary MWRC with independent sources, Ong et al. [11] constructed a functional-decode-forward for independent 
sources (FDF-IS) coding scheme to achieve the common-rate capacity (where all users transmit at the same rate). FDF-IS 
was extended to the finite field MWRC with independent sources and was shown to achieve the general-rate capacity JT2| 
(where the users can transmit at different rates). The capacity region of the general MWRC with independent sources, however, 
remains unknown to date. 

In source coding setups, the sources are assumed to be correlated, but the channel noiseless. The problem formulation is 
"how many bits does each node need to encode per message symbol?" Achievable rate tuples here refer to the tuple of the 
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number of bits (per source symbol) allocated to the encoders for which reliable reconstruction of each message is possible by 
the respective destinations (decoders). The challenge is to find the set of all achievable rate tuples. The source coding problem 
for the three-user MWRC was solved by Wyner et al. |TJ, using cascaded Slepian-Wolf source coding fl3) . The two-user 
lossless case and lossy case (where each user reconstructs the other user's message with a prescribed distortion) were studied 
by Su and El Gamal p4) , and the two-user lossy case with common reconstructions (where each user must also be able to 



determine what the other user reconstructs for its own message) was studied by Timo et al. 1 15 1. 

In this paper, we study both source and channel coding in one setup, i.e., three-user MWRCs with noisy channels and with 
correlated sources (c.f. our recent work [16| on the two-user MWRC with correlated sources). The users each send m source 
symbols (to the other users) in n channel uses. We say that the rate of re = n/m channel uses per source symbol is achievable 
if all users can reliably decode the messages of all other users. Our problem is to find the set of all achievable rates, which 
is equivalent to finding the necessary and sufficient conditions for achievable rates. In the multi-terminal network, it is well 
known that solving the source coding and the channel coding problems separately does not, in general, solve the source-channel 
problem, i.e., noisy channels with correlated sources (see, e.g., the multiple-access channel [171). We will, however, show that 
separating source coding and channel coding — using Slepian-Wolf source coding and FDF-IS channel coding — is optimal for 
two classes of the finite field MWRCs with correlated sources. In doing so, all achievable rates are found for these two 
classes of MWRCs. Furthermore, for sources with common cores, which is a source structure where each user can extract all 
the information it has in common (i.e., the correlated part) with other users, we construct two functional-decode-forward for 
correlated sources (FDF-CS) coding schemes and show that these schemes obtain the set of all achievable rates for all source 
and channel combinations. 

A. Organization 

The rest of this paper is organized as follows: We define the source and the channel models, present some definitions, and 
summarize the main results of this paper in Section [II] In Section III we review existing results of Slepian-Wolf source coding 



and FDF-IS channel coding independently. In Section IV we derive necessary conditions and sufficient conditions (based 
on Slepian-Wolf source coding and FDF-IS channel coding) for reliable communications over the three-user MWRC with 
correlated sources. We then obtain the set of all achievable rates for (i) two classes of MWRCs with general source structures 



in Section [V] and (ii) MWRCs with sources with common cores in Section VI Section VII concludes the paper. 

II. Main Results 

A. Source and Channel Models 

The three-user finite field MWRC with correlated sources is depicted in Fig.[T] in which nodes 1, 2, and 3 are the users, and 
node the relay. We consider full data exchange, meaning that each user is to decode the messages of the two other users. 
Let | ^Wj.[t], W^i], W 3 [tfj I be a sequence of triplets each generated according to the joint probability mass function 

p(wi,W2,w 3 ) = Pt{Wi = wx,W 2 = w 2 , W 3 = w 3 }, (1) 

over the alphabet W\ XW2XW3. Denote by (Wi, W 2 , W 3 ) a length- m block of this sequence, where W{ — (Wj[l], W»[2], . . . , 
Wi[ m ])' f° r * £ {1: 2, 3}. Here, the vector of m source symbols, Wi, is the message of user i. Each user must send its message 



3 




Fig. 1. The three-user finite field MWRC with correlated sources: The uplink communications are represented by solid lines, and the downlink communications 
by dashed lines. The square blocks are nodes, and the circles represent finite field additions. 

to the other two users via a discrete memoryless finite field MWRC defined as follows: 

Uplink: Y [t] = X x [t] © X 2 [t] © X 3 [t] © N [t] , (2) 

Downlinks: Yi[t] = X [t] © Ni[t], Vi € {1, 2, 3}, (3) 

for t e {1,2,...}, where X t [t], Yg[t], Ni[t] 6 J, Vf € {0, 1, 2, 3}, where J 7 is a finite field with the associated addition ©. 
Here, we have used the index i to denote a user, and the index I to denote a node (i.e., user or relay). The nodes operate in full- 
duplex mode: at time t, Xg [t] is node £'s input into the channel, Yg [t] is the channel output to node £, and Ni [t] is the receiver 
noise at node t. The channel is memoryless in the sense that each {Ni}^ 1 is independent and identically distributed according 
to some p(ni) = Pr{Ne = n?}, for all £ £ {0, 1, 2, 3}. So, we can focus on the generic channel Yq = X% © X 2 © X3 © iVo 
and Y{ — Xq © Ni, for all i £ {1, 2,3}. Note that the uplink and the downlinks are separated but are synchronized. 

The users exchange their source messages (each containing m source symbols) in n channel uses using the following code 
structure (possibly a joint source-channel code): 

• The t-th transmitted channel symbol of each node £ depends on all its m source symbols and its previously received 
channel symbols, i.e., X e [t] = f u (Wi,Y e [l},Y t [2], . . . , Yt[t - 1]), for all £ £ {0,1,2,3} and for all t £ {1,2,..., n}. 
Here, Wq = 0, as the relay has no message to send. 

• Each user i estimates the messages of the other users from its own message Wi and its n received channel symbols 
Yi = (Yi[l], Yi[2], . . . , Yi[n}), i.e., user i decodes the messages from users j and k as (Wj, Wk) — hi{Yi, Wi), for all 
i £ {1, 2, 3} where i ^ j ^ k. We always define j < k for convenience. 

Note that utilizing feedback is permitted in our system model. We refer to this model as the unrestricted MWRC (c.f. the 
restricted MWRC J3], (6), (5J, ||T8j). Unless otherwise specified, we use bold-faced symbols to denote vectors of length-m 
source symbols and length-n channel uses. The length of each vector should always be clear from context. 

The average end-to-end probability of error is defined as P e = Pr | (Wj, Wk) 7^ (Wj, Wk) ■ for any j,k £ {1,2,3} where 
j < fcj. We say that the rate n = njra (channel uses per source symbol) is achievable if the following is true: for any e > 0, 
there exists at least one code of the above structure with P e < e and n/m — k (m and n being sufficiently large). 
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B. Definitions 

Before presenting the main results of this paper, we define the following classes of sources and channels. Definition 1 is on 
the channel, while Definitions 2-4 are on the sources. The main results of this paper will hold for various combinations of 
these classes. 

1) Symmetrical channels: The channel is symmetrical if 

JI(JVi) = H(N 2 ) = H(N 3 ). (4) 

Otherwise, we say that the channel is asymmetrical. Here, H(X) — — J2 x p( x ) ^°S2P( X ) is me entropy (in bits) of the random 
variable X. 

We can think of H(Ni) as the noise level on the downlink from the relay to user i. So, a symmetrical channel means that 
all the downlinks from the relay to the users are equally noisy. 

Remark 1: For a symmetrical channel, we do not require that the noise level on the uplink, H(Nq), equals the noise level 
on each downlink, H(Ni) = H(N 2 ) = H(N 3 ). 

2) Correlated sources with almost-balanced conditional mutual information (ABCMI): The sources have almost-balanced 
conditional mutual information (ABCMI) if 

I(Wi; W 3 \W k ) < I{W 3 -W k \Wi) + I{Wi\ W k \Wj), (5) 

for all k £ {1, 2, 3} where ij^jjt k. Otherwise, the sources are said to have unbalanced conditional mutual information. 
Here, I(X;Y\Z) = — ^2 xyz p(x,y,z)log 2 \p(x\z)p(y\z)/p(x,y\z)] is the conditional mutual information of the random 
variables X and Y given Z. 

So, if the sources have unbalanced conditional mutual information, there must exist some user A £ {1,2,3}, such that 

I(W B ;Wc\W A ) = I{Wa;Wb\W c ) + I{W a ;W c \Wb) + V, (6) 

for some rj > and B, C £ {1, 2, 3} \ {A} with B^C. 

The next definition divides the class of unbalanced conditional mutual information into two sub-classes. 

3) Correlated sources with skewed conditional entropies (SCE): Sources with unbalanced conditional mutual information 
are said to have skewed conditional entropies (SCE) if [in addition to (|6]l] we have the following: 

H(WB,Wc\W A )>max{H{WA,W B \Wc),H(WA,Wc\W B )} +V: (7) 

for the same 77 as in |6]). Here, H(X, Y\Z) — — y z p( x ' V' z ) 1°§2 p( x i v\ z ) ls tne conditional entropy. 

Fig. [2] shows the relationship among the entropies and mutual information for the three source messages W\, W%, and W3 
for the cases described above. Referring to Fig. |2(a)| the shaded areas represent the mutual information between any two 
source messages given the third source message. For ABCMI, we have that any of the three shaded areas must not be bigger 
than the sum of the other two shaded areas. Suppose that the sources do not have ABCMI, then they must have unbalanced 
conditional mutual information, i.e., we can find a user A where I(Wb', Wc\Wa) is larger than the sum of I(Wa', Wb\Wc) 



and I(Wa', Wc\Wb) by an amount 7/ > (see Fig. 2(b) 1. In addition, for sources with SCE, we also have that for the two 
messages, Wb and Wc, whose mutual information conditioned on W A , i.e., I{Wb] Wc\ Wa), is larger than the sum of the 
other two pairs by the amount 77, their entropy conditioned on Wa, i-e., H(Wb, Wc\Wa), is also greater than that of any other 
pair (conditioned on the message of the third user) by at least rj. The information diagram for SCE is depicted in Fig. |2(b)| 
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W i H(W A ,Wc\W B )^ ~X ^H(W A ,W B \Wc) 

/(Wi;W3|W2) v / \ //(Wi;W 2 |W 3 ) 




I(W/ 2 ;W/ 3 |W : 



(a) almost-balanced conditional mutual information 
(ABCMI) 




I(Wb;W c \Wa) 



□ iJ(Wfl,W c |W A ) 
(b) skewed conditional entropies (SCE) 




(c) unbalanced conditional mu- 
tual information and without 
SCE 

Fig. 2. Entropy diagrams of three correlates sources: the values of /(•) and H(-) can be represented as signed measures on each diagram (Though not 
important as far as this paper is concerned, we note that the measure of the region * can be negative.) 



Fig. |2(c)| gives an example of correlated sources with unbalanced conditional mutual information and without SCE, where 
I(W B ; W C \ W A ) is strictly larger than the sum I(W A ] W B \W C )+I(W A ; W C \W B ), but H{W B , W C \W A ) is smaller than both 
H(W A ,W B \W C ) and H(W A ,W C \W B ). 

While the above source definitions (ABCMI, SCE) are determined by the relative sizes of conditional mutual information 
and conditional entropies, the next definition is determined by the source structure. 

4) Correlated sources with common cores : For correlated sources with common cores fl9) , we can write the messages of 
the users as 

W 1 = (U,P,Q,V) (8) 
W 2 = (Q,R,S,V) (9) 
W 3 = (S,T,U,V), (10) 

where P, Q, R, S, T, U, and V are mutually independent random variables. Fig. [3] depicts the relationship among the variables. 
In this setting, each user knows and can extract the exact information it has in common (or shared information, or the correlated 
parts) with other users. 

Remark 2: Correlated sources with common cores have either (i) ABCMI, (ii) SCE, or (iii) unbalanced mutual information 
without SCE. 



C. Main Results 

We now state the main results of this paper: For sources with either 
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Fig. 3. Sources with common cores, where P, Q, R, S, T, U, and V are independent random variables — they are not numbers [as in /(■) or H{ ) in 



(i) ABCMI, 

(ii) SCE on symmetrical channels, or 

(iii) common cores, 

a rate n > is achievable 
• [Converse] only if 



H(Wj,W k \Wi) < k log 2 \T\ - max{H(N ),H(N i )} 



(11) 



for all i, j, k € {1, 2, 3} where i ^ j ^ k; 
[Achievability] if (jTTJ holds with a strict inequality, i.e., 



(12) 



H(Wj,W k \Wi) < K [log 2 \F\-max{H{N ),H(Ni)}\, 

for all i, j, k € {1, 2, 3} where i ^ j ^ k. 
Similar to the source-channel separation result for the point-to-point channel, whether k is achievable when H(Wj, Wk\Wi) = 
K[log 2 (J 7 ! — m&x{H(No), H(Ni)}] depends on the specific sources and channel |20j pg. 174]. 
The above results are taken from the following theorems derived in this paper: 

• In Theorem [T] we derive necessary conditions for reliable communication for all source and channel combinations. 

• In Theorem [2] we derive sufficient conditions for reliable communication for all source and channel combinations, using 
Slepian-Wolf source coding and FDF-IS channel coding. 

From these two theorems, we find conditions for which the necessary and sufficient conditions (of Theorems [T] and [2] 
respectively) match, i.e., we obtain the set of all achievable rates in the following theorems: 

• In Theorem [3] for sources with ABCMI. 

• In Theorem |4] for sources with SCE on symmetrical channels. 

The sufficient conditions of Theorems [2] [3] and [4] are obtained using Slepian-Wolf source coding and FDF-IS channel coding. 
For sources with common cores, we propose two coding schemes — -functional-decode-forward for correlated sources (FDF- 
CS) — to obtain the set of all achievable rates in Theorem [5] 

The main results are summarized as shaded regions in Fig. |4] Note that ABCMI and SCE are mutually exclusive. For the 
remaining cases (i.e., the unshaded regions in Fig. [4]), the conditions imposed by ( fTTj ) are necessary for reliable communication, 
but may not be sufficient. For these cases, we obtain sufficient conditions for achievability, but the sufficient conditions and 
(11) may not match for all source and channel parameters. 
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the set of all channels 

Fig. 4. Main results of this paper: shaded regions (with the corresponding theorems) are the classes of source and channel combinations where the set of 
all achievable rates is found 

III. Existing Results 

We now review two existing results of channel coding and source coding for the three-user MWRC. We use upper-case 
letters to denote channel coding rates, and lower-case letters r\j to denote source coding rates. 

A. Functional-Decode-Forward for Independent Sources (FDF-IS) Channel Coding 

For the channel coding problem, the aim is to determine how many bits of data (per channel use) each user can transmit, 
through the noisy channel, such that the data can be reliably recovered at the respective destinations. Here the source messages 
are assumed to be mutually independent and uniformly distributed, i.e., p{w\, W2, W3) — p a (wi)p u (w2)p u {w3), with each 
p u (wi) being the uniform distribution on VV,-, for all i £ {1,2,3}. Suppose that each user i transmits at the channel coding 
rate of Ri bits per channel use. Using the notation in this paper, where the users exchange {M^J over n channel uses, we 
have Ri = m\og 2 \ Wi\/n. Ong et al. fl2) have shown that P e can be made arbitrarily small, i.e., reliable communication is 
possible, 

• [Converse] only if 

Ri + Rj < log 2 m - m^{H(N ),H(N l )}, (13) 

for all i, j, k £ {1, 2, 3} where i ^ j 7^ k; 

• [Achievability] if ( fl3] l holds with a strict inequality for all i, j, k £ {1, 2, 3} where i 7^ j 7^ k. 

The above channel capacity result was obtained using FDF-IS, which is a round robin scheme using linear block codes. At 
each time, two users transmit, and the relay decodes the finite field addition of the transmitted codewords to obtain a function 
of the transmitted messages. The relay then re-encodes and forwards the function back to the users. From this function, and its 
own message, each user can then decode the other users' messages if ( fT3] l is satisfied with a strict inequality. The idea behind 
this coding scheme is that the relay decodes a function of the source messages just sufficient for each user to recover the other 
user's messages. Based on this idea, we will propose (in Section |VI[ ) two functional-decode-forward schemes for correlated 
sources with common cores, where the uplink transmission of the users and functions that the relay decodes may be different 
from those in FDF-IS. 
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B. Slepian-Wolf Source Coding 

For the source coding problem, the aim is to determine to how many bits per source symbol triplet (the source symbols of 
the users are generated synchronously) each node can encode such that the source symbols can be reliably recovered at the 
respective destinations. Suppose that each node I encodes at the source coding rate of n bits per source symbol triplet, for 
all £ € {0, 1, 2, 3}. Let the source-encoding output of node £ be an mr^-bit index, denoted by Mg E {0, 1, . . . , 2 mre — 1}. 
The channel is assumed to be noiseless such that (i) on the uplink, the relay receives M\, M%, and M 3 ; and (ii) on the 
downlink, each user i G {1, 2, 3} receives Mo- Wyner et al. [1] have shown that P e can be made arbitrarily small, i.e., reliable 
communication is possible^ 

• [Converse] only if 

ri>ff(Wi|WO,W fc ) (14) 
n + rj>H{W u Wj\W k ) (15) 
T >H{Wi,Wj\W k ), (16) 

for all i,j,k £ {1,2, 3} where i ^ j ^ k; 

• [Achievability] if (|T4]> — (fl~6|> hold with strict inequalities for all k g {1, 2, 3} where i ^ j ' ^ k. 

The above source coding result was obtained using cascaded Slepian-Wolf coding. Each user i first performs random binning 
to encode its message Wj to the index Mi, for i £ {1,2,3}. The indices are given to the relay. Having (Mi, M2, M$), the 
relay performs random binning to obtain the index Mo, and broadcasts it to the users. From Mo and Mi, each user i can 
decode the other user's source messages, Wj and Wk, using the following two steps: 

(i) [Index recovery] From the relay's index Mo and its own index Mj, each user i can reliably recover the indices of the 
other users, Mj and Mfe, if (JT6J is satisfied with a strict inequality. 

(ii) [Message recovery] From the indices of the other users, Mj and M k , and its own source message Wj, each user i can 
decode the source messages of the other users, Wj and Wk, if ( [14) and ( fl"5j ) are satisfied with strict inequalities. 



The coding operation described above differs from that described in Section II- A| in, at least, the following two ways: 

• The index of each user i, Mi, depends only on its source message Wj, for i € {1,2,3}, i.e., there is no feedback at the 
users. 

• The index of the relay, Mo, can depend on (Mi, M2, M3) non-causally. 

In the next section, we propose a separate source-channel coding scheme for MWRCs with correlated sources and with noisy 
channels, where the source coding is based on Slepian-Wolf coding, and the channel coding is based on FDF-IS. 

Remark 3: Wyner et al. have shown that conditions (fT4")>-(fl"6l> are also necessary for reliable communication when feedback 
is available at the users — achievability is based on the above coding strategy. 

IV. Conditions for Achievability 

We now give necessary conditions and sufficient conditions for reliable communication for the three-user finite field MWRC 
(with a noisy channel) with correlated sources. 

*Note that the rates n defined here are slightly different from those defined by Wyner et al. (c.f. [l] eqn. (10)]). The converse here follows directly from 
|T| eqns. (18)-(23) with A(P e ,N) -» 0]; achievability follows from JT] sec. II.B where the rates have been set to R t = (logM e )/N, W e {x, y, z, s}]. 
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A. Necessary Conditions for Achievability 

We first prove the following necessary conditions for achievability: 

Theorem 1 (Necessary conditions): Consider a three-user finite field MWRC with correlated sources. A rate n > is 
achievable only if 



H(Wj, W k \Wi) < k log 2 |JT| - m & x{H(N ),H{N l )} 



(17) 



for all k <E {1, 2, 3} where i ^ j ^ k. 



To prove the above necessary conditions for achievability, we first extend the cut-set argument in [21 pgs. 587-591] for 
networks with independent sources to those with correlated sources. We then apply this result to the three-user finite field 
MWRC. We present the proof in Appendix [A] 

B. Sufficient Conditions for Achievability 

We now construct a coding scheme using (i) Slepian-Wolf source coding for the noiseless MWRC with correlated sources, 
and (ii) FDF-IS for the finite field MWRC with independent sources. This scheme yields the following sufficient condition for 
achievability: 

Theorem 2 (Sufficient conditions): Consider a three-user finite field MWRC with correlated sources. A rate k > is 
achievable if there exists three positive channel coding rates Ri, i? 2 , and i?3 such that 

R i >-H(W i \W j ,W k ) (18) 

K 

R j + R k >-H(W j ,W k \W i ) (19) 
hi 

Ri +R k < log 2 \T\ - max{H(N ), H(N Z )}, (20) 

for all k € {1, 2, 3} where i ^ j ^ k. 

Remark 4: Conditions (p"9|)-(|2"0|) correspond to ( fTTj ) in Theorem [T] Our coding scheme further requires < p~8] > to hold, which 
is restrictive for some sources and channels. 

Proof of Theorem^ We first define the source and channel coding methods. 

[Source coding] We first use Slepian-Wolf source coding. Each user i encodes its message W \ to an mr^-bit message 
M[ E {0, 1, . . . , 2 mVi — 1}, satisfying ( fi4] i and (JT3J with strict inequalities, for i £ {1, 2, 3}. Each user i randomly generates 
an mr^-bit dither Di uniformly distributed in {0, 1, ... , 2 mri — 1}, and forms its encoded message Mj = M[ + Di mod 2 mri . 
The dithers are known to all nodes. Now, M\, M 2 , and M3 are mutually independent, and each M, is uniformly distributed 
in {0,1,..., 2 mr * - 1}. 

[Channel coding] We use FDF-IS channel coding for the users to exchange the encoded independent messages M\, M 2 , 
and M3 via the relay in n channel uses. Let Ri = mri/n. From Section III-A| we know that if ( fT3| is satisfied with a strict 



inequality, then each user i can reliably recover Mj and M k , for all i,j, k £ {1, 2, 3} where i 7^ j ^ k. Knowing the dithers, 
it can also recover Mj and M' k . 

From Section III-B we know that if ( fT~4| > and (jT3J are satisfied with strict inequalities, then each user i can reliably recover 



(Wj, Wk) from (Wi, Mj,M' k ). So, if ( fl"3j ), (jT4), and ( [T5] > are satisfied (with strict inequalities) with r, ; = KR4, then the rate 
of k = n/m is achievable. ■ 
In the rest of this paper, we denote this coding scheme of using Slepian-Wolf source coding and FDF-IS channel coding as 
defined above by SW/FDF-IS. 
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Remark 5: The SW/FDF-IS scheme proposed here is not simply selecting appropriate channels to support the source coding 
operation proposed by Wyner et al. (see Section III-Bi, i.e., finding uplinks to allow the relay to decode (Mi, M 2 , M 3 ), 



and downlinks to allow the relay to send Mo to the users. In fact, we previously showed that having the relay fully decode 
(Mi,M 2 ,M 3 ) can be sub-optimal (Hj. In SW/FDF-IS, we first use Slepian-Wolf source coding to generate (Mi,M 2 ,M 3 ), 
and then use FDF-IS for the relay to decode a function of (Mi,M 2 ,M 3 ) and forward this function to the users. 

C. Source-Channel Separation 

In SW/FDF-IS, the relay decodes and transmits a function of (M 1; M2,M 3 ). Let R be the channel coding rate at which 
the relay transmits this function on the downlink, and ro — kRq be the corresponding source coding rate (i.e., number of bits 
in the function per source symbol triplet). The FDF-IS channel code requires that (T2) 



Rq > max Rj + R k . (21) 

j,fce{i,2,3}j#fc 

This means for any (i?i, R 2 , i? 3 ) that satisfies ( |19) , we must have 

r = kR > K[Rj + R k ] > H{W 3 ,W k \Wi), (22) 

for all i, j, k £ {1,2, 3} where i ^ j ^ k. So, the necessary condition for achievability imposed on the relay, i.e., (jT6]» — which, 
at first sight, seems not required in Theorem [2] — is implicitly guaranteed by the FDF-IS channel code. 



If ( fT6] l is always true, then the source coding region in Section III-B can be specified by all triplets (r 1 ,r 2 ,r 3 ) that satisfy 
( fl4| i and ( fT3] > with strict inequalities. Hence, we re-state the achievable rates in Theorem [2] as the intersection of the source 
coding and the channel coding regions: 

Corollary 1: Consider a three-user finite field MWRC with correlated sources. A rate k > is achievable if 

^-source ^ ^'/^-channel + 0, (23) 

where lZ somce is the source coding region given by the set of all (ri, r 2 , r 3 ) satisfying ( p"4| ) and ( fT3] > with strict inequalities for all 
k £ {1, 2, 3} where i 7^ j ' ^ k, and K72. c hannei is the channel coding region given by the set of all positive (kRi, kR 2 , kR^) 
satisfying ( fT3| i with a strict inequality for all k £ {1, 2, 3} where i ^ j ^ k. 

The above characterization highlights that SW/FDF-IS is a separate source-channel coding scheme, depicted in Fig. [5] The 
source coding (blocks SEi and SDi, i £ {1,2,3}) operates in 7vL soulce and is designed independent of the channel model and 
the channel codes; the channel coding (blocks CEi and CDi, i £ {1, 2, 3}) operates in 7\L c h a nnei and is designed independent of 
the source statistics and the source codes. 

Remark 6: The separate source-channel architecture described here is restricted in the following sense: each user sends only 
one (source coding) index, i.e., common message, to the other two users. In general, a separate source-channel code would 
also permit private messages to the other users. 

V. Necessary and Sufficient Conditions for Sources with ABCMI and with SCE 

We now describe some situations for which the above necessary and sufficient conditions actually match. Note that any three 
correlated sources must belong to one of the following two classes: (i) with almost-balanced conditional mutual information 
(ABCMI), or (ii) with unbalanced conditional mutual information. 
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Fig. 5. SW/FDF-IS: a separate source-channel coding architecture 



A. Sources with Almost-Balanced Conditional Mutual Information (ABCMI) 
For sources with ABCMI, i.e., when |5]) is true, we have the following lemma: 

Lemma 1: Consider three (possibly correlated) random variables W\, W 2 , and W 3 , and any k > and S > 0. If the sources 
have ABCMI, then we can always find some R\ > 0, R2 > 0, and R3 > 0, such that 

S 



kRi > H{Wi\W 2 ,W 3 ) + 
kR 2 > H{W 2 \W U W 3 ) + 
kR 3 > H(W 3 \W 1 ,W 2 ) + 



k(Ri + R 2 ) = H(Wi, W 2 \W 3 ) + 5 
n{R x + R 3 ) = H(W 1: W 3 \W 2 ) + S 
k{R 2 + R 3 ) = H(W 2 ,W 3 \W 1 ) + S. 

Proof of Lemma [7J It can be shown that choosing 

KRi = H{W t \W 3 , W k ) + \ [l(W t ; W k \W ) + I(W t ; W 3 \W k ) - I(W r , W k \W t ) + 6 



(24) 
(25) 
(26) 
(27) 
(28) 
(29) 

(30) 



for i, j, k € {1, 2, 3} where i ^ j ^ k, satisfies ([24j— ([29j. ■ 
With the above lemma, we can prove the following theorem: 

Theorem 3 (ABCMI): Consider a three-user finite field MWRC with correlated sources having ABCMI. A rate k > is 
achievable 

• [Converse] only if 



HiWjMWi) < K [\og 2 \T\^max{H(N ),H(N i )} 
for all i,j,k G {1,2, 3} where i ^ j ^ k; 

[Achievability] if ( f3T| holds with a strict inequality for all i,j, k £ {1, 2, 3} where i 7^ j 7^ k. 



(31) 
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6 = mm 



Proof of Theorem^ The converse follows directly from Theorem [T] We now show that for ABCMI [i.e., when |5]l is 
true], the conditions imposed by 

HiWjMWi) < K [log 2 \F\-max{H(N ),H(Ni)}\, (32) 

for all i,j, k G {1,2,3} where i ^ j ' ^ k, are sufficient for reliable communications. If ([32} is true, we can always define a 
positive real number i5 as follows: 

l\ K [log 2 \F\- H(N )] -H{W v W k \W l ), 

K[\og 2 \F\- H{Ni)] - HiWjMWi)} (33) 

Let k be any positive rate that satisfies (3Z) . First, choosing i? 2 , and U3 as in ( f30| >, from Lemma [T] ( fT8] > and ( fT9) i are 
satisfied. 

Also, by definition, H(Wj, W k \Wi) + 2S < K[log 2 - max{H(N ), H(Ni)}}. Substituting any equations from (|27>— <|29>, 
we have 

(Rj + R k ) + S/k < log 2 | T\ - max{H(N ),H(N l )}, (34) 

for all i, j, k G {1, 2, 3} where i ^ j ^ k, and <5/k > 0. This means ( p0] > is satisfied for the chosen i? 2 , -R3). So, the rate 
k is achievable. ■ 
Remark 7: If the sources are independent, we have H(Wi : Wj\Wk) — H{Wi) + H(Wj) for all i,j,k € {1,2,3} where 
i ^ j ^ fc. In this case, |5]l is always satisfied, i.e., all independent sources have ABCMI. Define Tj = H(Wi)/n = mH(Wi)/n 
as the number of message bits transmitted by user i per channel use. Reliable communication is possible (i) only if tj + r k < 
log 2 — m&x{H (Nq), H(Ni)}, for all k £ {1,2,3} where i 7^ j 7^ fc; and (ii) if the conditions hold with strict 
inequalities. With this we recover the capacity region of the three-user MWRC with independent sources fT2| . 

B. Sources with Unbalanced Conditional Mutual Information 

For sources with unbalanced conditional mutual information, i.e., when Q is true, we have the following lemma: 
Lemma 2: Consider three (possibly correlated) random variables W\, W2, and W3, and any k > and ip > 0. If the sources 
have unbalanced mutual information, then we can always find some R A > 0, Rb > 0, and Rc > 0, such that 

kR a = H(W A \W B , W c ) + \ (35) 

kR b > H(W B \W A , W c ) + (36) 

Ki?c > H{W C \W A , W B ) + (37) 

k(Ra + Rb) = H{Wa,W b \W c ) + ~ + iI) (38) 

K(R A + R c ) = H(W A ,Wc\W B ) + l+ip (39) 

k(R b + Rc) = H{Wb,W c \Wa) + ^, (40) 

for r\ > defined in d6]l. 

Proof of Lemma [2j Constraint Q implies the following: 

I(W b ;Wc\Wa)+I{Wa;Wb\Wc)-I(W A ]Wc\Wb) = 2I(W A ;W B \W c ) + v> V (41) 
I(Wb;Wc\W a ) + I{W A ; W c \W b ) - I(W A ] W B \W C ) = 2I(W A ; W C \W B ) +v>V (42) 
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First, we can always choose a positive number Ra as in ( |35| >. In addition, we choose 

1 



kR b = H(W B \W A ,Wc) 



kR c = H(Wc\W a ,W b ) 



I(W b ; W c \Wa) + I{W A ; W B \W C ) - I(W A ) W C \W B ) + (43) 

I(W B ; W c \Wa) + I(W A ; W C \W B ) - I{W A ; W B \W C ) + i/>] . (44) 

Substituting (HT1) into ( |43| ), we get ( |36] i; substituting ( |42] i into ( |44] >, we get ( |37| ). Summing different pairs from ( (35} , ( |43| , 
and (|44]l, we get <[38])-<[40), ■ 

Now, we further categorize sources with unbalanced mutual information into the following sub-classes: (i) with skewed 
conditional entropies (SCE), or (ii) without SCE. 

1) With skewed conditional entropies (SCE): For sources with SCE, i.e., when both |6]) and |7]i are true, we have the 
following result: 

Theorem 4 (SCE): Consider a symmetrical three-user finite field MWRC with correlated sources having SCE. A rate k > 
is achievable 

• [Converse] only if 



H(Wj,W k \Wi) < k log 2 - m&x{H(N Q ), H(N t )} 



(45) 



for all i, j, k € {1, 2, 3} where i ^ j ^ k; 
• [Achievability] if (j45j holds with a strict inequality for all i,j,k E {1, 2, 3} where i 7^ j 7^ k. 

Proof of Theorem |5f The converse follows from Theorem [T] So, we only need to show achievability. For a symmetrical 
channel, we can define H(Nd) = H(Na) = H(Nb) = H(Nc), where the subscript "d" denotes downlink. Eqn. |7]i for SCE 
implies that d45| with a strict inequality reduces to 



H(Wb,W c \Wa) < k 



log 2 \T\ 



c{H(N ),H(N d )} 



(46) 



We will now show that for all symmetrical MWRCs where the sources have SCE, if ( |46] l is satisfied then the rate k is 
achievable. 
First, define 

2^ K [log 2 |7-| ~me^{H{N ),H(N d )}\ - H(W B , W C \W A ), (47) 

where ip > 0. From Lemma|2] we can choose Ra, Rb, and Rq such that conditions ( fT8| > and ( fT9] l in Theorem [2] are satisfied. 
In addition, for the chosen Ra, Rb, and Re, we have 



k(R b + Ra) - H(W B , W c \W a ) + 4> 

"log 2 |J-|-max{ff(7V ),^(^d)} 
log 2 \F\-m a x{H(N ),H(N d )} 



-ij> 



< K 



k(Rj 



Rb) = H(Wa,Wb\W c ) + 7 ±+^ 
<H(Wb,Wc\Wa)-1+tJj 



< K 



n(R A + Rc) = H(W A , W c \W b ) 
< H(W B ,Wc\W A ) 



\og 2 \F\- m^{H(N ),H{N A )} 



< K 



\og 2 \F\ -mtix{H (N ), H(N d )} 



(48a) 
(48b) 
(48c) 
(48d) 
(48e) 
(48f) 
(48g) 
(48h) 
(48i) 
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where < |48a) follows from (|40), ( |48b) follows from (gTJl, (gSd) follows from ((38), ( |48e) and ( |48h) follow from ((7), <|48f) and 

( pi) follow from g8a)-g8c), and ( |48g) follows from ((35). 

The above three conditions are equivalent to ( pO) in Theorem [2] This means the rate k is achievable. ■ 
2) Without skewed conditional entropies (SCE): Consider sources without SCE but with unbalanced conditional mutual 

information, i.e., |6) is true with the following additional constraint: 

H(W B ,W C \W A ) < max {h(W a ,Wc\Wb),H(W a ,W b \W c )}+V- (49) 
For this case, we will show, using an example, that SW/FDF-IS might not be optimal, i.e., not all rates that satisfy Theorem[T] 



are achievable using this coding scheme. We consider the source structure depicted in Fig. 2(c) i.e., H(Wa,Wb\Wc) = 
H(Wa, Wc\W b ) = 7 and H(Wb,Wc\W A ) = 5, and the channel with the following parameters: log 2 \T\ - H(N Q ) = 7, 
log 2 | T\ - H{Ni) = 10, for all i e {A, B, C}. 

The rate of k > 1 is necessary for reliable communication (from Theorem (T). Suppose the rate k — 1.05 is achievable using 
SW/FDF-IS, then, from Theorem [2] we must be able to find three positive real numbers Ra, Rb, and Rc such that 

R A > 5/1.05 (50) 

mm{R B ,Rc} > 1/1.05 (51) 

mm{R A + Rb,Ra + Rc} > 7/1.05 (52) 

R B + Rc > 5/1.05 (53) 

ma,x{R A + Rb,Ra + Rc,Rb + Rc} <7- (54) 

From ((50) and ((53), we must have maxji?^ + Rb,Ra + Rc} > 7.5/1.05 = 7.14. This means ( (54) cannot be satisfied, and 
hence not all rates satisfying k > 1 are achievable using SW/FDF-IS. 

VI. Necessary and Sufficient Conditions for Correlated Sources with Common Cores 

In the previous section, we have derived the necessary and sufficient conditions for reliable communication for two classes 
of three-user finite field MWRCs with correlated sources. In this section we will show necessary and sufficient conditions for 
reliable communication for all three-user finite field MWRCs with correlated sources if the sources have common cores. 

Refer to (|8)-(fT0) and Fig. [3] for sources with common cores. To simplify the analyses in this section, let each independent 
component \ € {P, Q, R, S, T, U, V} of the correlated sources be a random binary vector of length D x , i.e., \ S {0, l} Dx , 
with each binary digit in the vector drawn according to the uniform distribution on {0, 1}. This means its entropy H(x) = D x . 
The results in this section can be extended to any discrete-memoryless sources with common cores, with appropriate source 
coding to encode the sources to binary digits (see Remark [8] below). 

We assume that each node knows H (%) for all \ € {P, Q, R, S, T, U, V}. This means the users know how many bits of data 
they are decoding from other users a priori, but (obviously) they do not know the actual data. This is a reasonable assumption 
since a user can infer this information (i.e., the number of bits it must decode) from the source and channel codebooks that it 
uses for decoding. 

Without loss of generality, let 

H(W 1 ,W 2 \W 3 ) > ma,x{H{W 2 ,W 3 \W 1 ),H{W ll W 3 \W 2 )}, (55) 

or equivalently, 

H(P) + H(Q) + H(R) > max{H(R) + H(S) + H(T),H(T) + H(U) + H(P)}. (56) 
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This means, for sources with common cores, the necessary conditions for reliable communication stated in Theorem [T] (with 
strict inequalities) can be written in the following form: 



H(P) + H(Q) + H(R) < K [log 2 \T\-H(N ) 
H(P)+H(Q)+H(R) < K [log 2 \T\-H(N 3 ) 
H{R)+H(S) + H(T) < Jlog 2 \F\-H(Nx) 
H(T)+H(U) + H(P) < K \ log 2 | J"| -H{N 2 ) 



(57) 
(58) 
(59) 
(60) 



Here, (|57) is the uplink constraint, and (|58"]l-(|60"]l the downlink constraints. 

Now, we will use a constructive proof to show that the above conditions are sufficient for reliable communication. Using the 
idea of functional decoding in FDF-IS, we will propose two functional-decode-forward for correlated sources (FDF-CS) coding 
schemes, one for the case where H(Q) < H(T) and another one for H(Q) > H(T), that achieve reliable communication 
for all k satisfying (|57]>-(|60]>. In the coding schemes that follow, we choose sufficiently large m and n, while maintaining the 
ratio k = n/m. 



A. When H(Q) < H(T) 

Recall that the users exchange m copies of the source symbols over n channel uses. First, at node 3, we split the message 
T into two independent sub-messages: T a and T b , i.e., T — (T a ,T b ), such that 

H(T a ) = H(Q) = mH(Q) (61) 
H(T b ) = H(T) -H(Q)= m[H{T) - H(Q)] . (62) 

Note that while Q is not known to user 3, H(Q) is. 

To split the message T, which is a binary vector of length mH(T), let the first mH(Q) binary digits be T a € {0, l} mH (Q\ 
and the remaining m[H(T) - H(Q)} binary digits be T b e {0, l} m l H ( T )~ H (Q)} . With this we have (|6TJ and ([52). Note that 
T a is a binary vector of length H(T a ), and T& is a binary vector of length i/(T;,)[^] 

Remark 8: For general discrete-memoryless sources T and Q (which are not necessarily binary vectors), we can first perform 



source coding on T to obtain a length-^ binary vector T', where l/m « H(T)/m = H(T) |20 pg. 105]. Let the first \mH(Q)] 
binary digits of T 1 be T a and the remaining I — \mH(Q)~\ binary digits be TV Doing this, we can write T' — (T a ,Tf,), 
where H(T a )/m « H(Q) and H(Tb)/m « H(T) — H(Q). Here and in the rest of this paper, we use the symbol w to denote 
"arbitrarily close to, with a sufficiently large m". 

Second, at node 1, we split P into three independent messages: P a , P b , and P c , i.e., P = (P a , P b , P c ), such that 



H(P a ) = H(S) 

H(P b ) = H(T b ) = H{T) - H(Q) 
H(P C ) = H(P) - H(P a ) - H(P b ). 



(63) 
(64) 
(65) 



Again, node 1 knows H(T) and H(Q) but not T and Q. Note that the above split is possible because, from (|56J, we know 
that H(P) + H(Q) > H(S) + H(T), giving H(P) > H(S) + H{T) - H(Q) = H(S) + H(T b ). 

< Although the sub-message T a is denoted by using a bold letter to be consistent with T, we do not define T a . So, one should not think of the message 
T a as a vector of T a . 
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Last, at node 2, we split R into three independent messages: R a , R b , and R c , i.e., R — (R a , Rb, Rc), such that 

H(R a ) = H(U) 

H{R b ) = H(T b ) = H(T) - H(Q) 
H(R C ) = H(R) - H(R a ) - H(R b ). 



(66) 
(67) 
(68) 



Similar to the splitting of P, the above split is possible because H(R) > H(U) + H(T b ), which follows from ( |56 
The uplink transmission is as follows: 

[when H(Q) < H(T)] 



n uplink channel uses 


Pa 


Pc 


Pb 


Q 


Rb 


R c 


Ra 


s 








T b 




U 



Referring to the uplink constraint ( |57j ), we align the uplink transmission to P, Q, and R, i.e., we do not send more aligned 
bits than H{P) + H(Q) + H(R). 

Note that P must be transmitted by user 1, R by user 2, and T by user 3. However, the common component S can be 
transmitted by either user 2 or user 3. Similarly, Q can be transmitted by users 1 or 2, and U by users 1 or 3. Also note that 
in the above transmission scheme, any two messages transmitted simultaneously are of the same size. 

For each message A £ {0, 1}^( A ) [a length-_ff (A) binary vector] in the above table, the user bijectively maps it to a 
length-fc' finite field message, A £ T k , where 2 H ( A ^ < \jF\ k . The user then transmits using a random linear block code of 
the form c(A) = A& ® d, where c(A) E T n is the length-n' finite field codeword, G is the generator matrix, and d is the 
dither vector. 

If there is only one message being transmitted, from the capacity-achieving property of random linear block codes on the 
finite field channel, the relay can reliably decode c(A) if H(A)/n' < log 2 \ J-\ — H(Nq), where H(A)/n' the number of bits 
in A per channel use, and log 2 |-7-| — H(Nq) is the "uplink capacity" from the users to the relay fl2) . 

When two messages are sent simultaneously (using a same G and different dithers), the relay decodes the finite field 
summation of the codewords, or equivalently, it decodes the finite field summation of the corresponding finite field messages. 
For example, let two finite field messages A and B [corresponding to the messages A and B respectively, with H{A) = H(B)] 
be transmitted simultaneously. The relay decodes the codeword c(g(A, B)) = c(A) c(B) 6 F n , where the corresponding 



"message" is g (A,B) = A®B e F k . We have shown [ 12] the following: 

(i) Due to linearity, the code {c(g(A, B))} is also a linear code taking the same form as {c(A)}. So, the relay can reliably 
decode c(g(A,B)) if H(A)/ri < log 2 |J"| - H(N ). 

(ii) The normalized entropy H(g(A, B))/m can be made arbitrarily close to H(A)/m = H(B)/m, by choosing a 
sufficiently large m, and an appropriate k', such that k' log 2 \F\/m w H (A)/mj^| Note that g(A, B) € T k , and it 
can be shown that H(A) < H(g(A, B)) < k' log 2 \T\. 

(iii) We can obtain B from g(A, B) and A. 

(iv) We can obtain A from g(A, B) and B. 

For the uplink transmission shown in the table above, the relay decodes W = [g(P a , S), P c , g(Pb, T b ),g(Q, T a ),g(Ri,, T b ), R c , g(Ra, 

^For fixed underlying source parameters, H(A)/m is a constant, independent of m. 
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Using the results in point (i) above for each transmission block, the relay can reliably decode W if 
1 



or equivalently, 



H(P a ) + H(P C ) + H(P b ) + H{Q) + H{R b ) + H{R C ) + H(R a ) < log 2 \T\ - H(N ) 



H(P) + H{Q) + H{R) < k log 2 1 T\ - H(N ) 



After decoding W, the relay re-encodes and broadcasts it on the downlink. User 3 can reliably decode W if 

-H(W) < log 2 |.F| - H(N 3 ), 



(69) 



(70) 



(71) 



where log 2 \ J~\ — H(N 3 ) is the "downlink capacity" from the relay to user 3. Noting that H(W)/m can be made arbitrarily 
close to [H(P) + H(Q) + H(R)]/m [refer to point (ii) above], we have 



H(P) + H(Q) + H(R) < K log 2 \T\ - H{N 3 ) 



(72) 



being a sufficient condition for reliable decoding of W at user 3. Since user 3 knows S, T, and U, it can decode P, Q, and 
R, from which it can obtain W\ and VF 2 . 

Recall that user 1 knows U, P, and Q. This means it knows P c , which is a part of W. Using the result of broadcast 
channels with receiver side information fl2) , (jTHJ, J22) , node 1 can reliably decode all the parts of W except P c , denoted by 

W_ Pc 4 \ g (P a ,S),g(P b ,T b ),g(Q,T a ),g(R b ,T b ),R c , 

g{R a ,U)], where H(W\P c )/m = ff(W_ Po )/m w H (R) + H(S) + H{T), if 



H(R) + H(S) + H{T) < k log 2 \T\ - H(Ni) 



(73) 



From the decoded information and its own message, user 1 can then decode W2 and ^3. Note that T b is sent twice. So, 
user 1 can first obtain T b from g(P b ,T b ) and its own message P b . It then obtains R b from g(R b ,T b ) and TV 
Using a similar argument, user 2 can reliably decode W-r c if 



H(T) + H{U) + H(P) < k log 2 |^| - H(N : 



(74) 



From W_i£ c and it own message, user 2 can obtain W \ and W 3 . 

So we have shown that, by using the FDF-CS coding scheme proposed above, conditions (|57]i-(|60]l are sufficient for reliable 
communication when H(Q) < H(T). 

Remark 9: Slepian-Wolf source coding is not used here, as the source messages consist of independent components. Only 
functional-decode-forward channel coding is used. 

Remark 10: The FDF-CS coding scheme proposed here is an extension of the FDF-IS coding scheme for the finite field 
MWRC with independent sources [12]. If the sources are independent, i.e., Q = S = U = 0ox H(Q) = H(S) = H(U) = 0, 
then the above FDF-CS coding scheme reduces to FDF-IS. 

B. When H(Q) > H(T) 

Now, we will construct another FDF-CS coding scheme to show that conditions (|57]i-(|60]i are also sufficient for reliable 
communication when H(Q) > H(T). 

First, we split Q into two independent messages, i.e., Q — (Q a . Q b ) such that 

H(Q a ) = H(T) (75) 
H(Q b ) = H(Q) - H(T). (76) 
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Since users 1 and 2 both know Q, this step can be performed at either user. 

From §S), we have H(P) + H(Q) > H{S) + H(T) and H(Q) + H(R) > H(T) + H{U). The uplink transmission is as 
follows: 

[when H(Q) > H(T), H(S) > H(P), H(U) > H(R)] 



n uplink channel uses 


P 


Qa 




R 




T 






S a 




s b 










u b 


u a 




* 





The section where three messages are sent simultaneously on the uplink is marked with *. Again, referring to the uplink 
constraint (|37j, we align the uplink transmission to P, Q, and R. 
Note the following: 

. The message S is split into (S a , S b ), where H(S a ) = H(P), if H(S) > H(P). Otherwise, S a = S and S b = 0. 
. The message U is split into (U a , U b ), where H(U a ) = H(R), if H(U) > H(R). Otherwise, U a = U and U b = 0. 
If H(S) < H{P) and H(U) < H(R), the scheme looks as follows: 

[when H(Q) > H(T), H{S) < H(P), H(U) < H(R)] 



n uplink channel uses 


Pa 


Pb 


Qa 


Qb 


R a 


Rb 




T 






s 














U 



In this case, P and R are both split. 

For the discussion for achievability, we consider the case where H(S) > H(P) and H(U) > H(R). The achievability for 
the other three combinations follows easily. It can be shown that 

max{H (Sb), H(Ub)} < H(Q b ). For this discussion, we consider the case where H(Sb) < H(Ub) < H(Q b ), so the messages 
U b and Q b are further split as follows: 



Qbi 


Qbi 


Q b3 


s b 






Ubi 


Ubi 




* 





Similar to the previous section, the users transmit using linear codes on the uplink. For the transmission segment marked with 
*, the relay decodes the finite-field summation of three linear codewords. Equivalently, it decodes the function g'{Q b i , S b , U b i) — 
Q bl © Sb S3 Ubi, where Q bl , Sb, and Ubi are binary vectors of length H(Q bl ). Using the results of linear codes |12 



and 



similar arguments as for the case of simultaneous transmission of two messages in Section |VI-A| we obtain the following: 
(i) Let the length of the codewords transmitted be n'. The relay can reliably decode g'(Q bl , S b , U b i) if H(Q bl )/n' < 
log 2 \T\ - H(N ). 
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(ii) The normalized entropy H(g'(Q bl , S b) U b x))/m can be made arbitrarily close to H(Q bl )/m = H(S b )/m = H(U b i)/m, 
for a sufficiently large to. 

(iii) Knowing the function </(•) and two of the messages, we can obtain the third message. 

On the uplink, the relay decodes V = [g(P, S a ),g(Q a ,T),g'(Q bl , S b , U bl ),g(Q b2 , U b2 ),Q b3l g{R, U „)]. Using the result 
in point (i) above for each transmission block, the relay can reliably decode V if 
1 r 



or equivalently, 



H(P) + H(Q a ) + H{Q bl ) + H(Q b2 ) + H(Q b3 ) + H(R) < log 2 \T\ - H(N ), 



H(P) + H(Q) + H(R) < k log 2 \F\ - H(N ) 



(77) 



(78) 



The relay then re-encodes and broadcasts V on the downlink. 

Note that H(Y)/m w H(P) + H(Q) + H(R) [refer to point (ii) above]. So, user 3 can reliably decode V if 

H(P) + H(Q) + H(R) < k [ log 2 1 F\ - H(N 3 ) 

Knowing S, T, U, and V, it can decode P, Q, and R, and then obtains W\ and W 2 - 

Knowing Q b3 in V, user 2 decodes only V-Q b3 = [g(P,S a ),g(Q a ,T),g'(Q bl ,Sb,U bl ), 
g(Q b2 , U b2 ),g{R, U a )}, where H(Y\Q ba )/m - H(Y. Q J/m « H{T) + H(U) + H(P). It can reliably do so if 

H(T) + H(U) + H (P) < k [ log 2 \F\ - H{N 2 ) 

Knowing it own messages Q, R, and S, it can then recover W\ and W 3 . 

Using a similar argument, knowing P, Q, and U, user 1 can reliably decode ^~(g(Q b2 ,u b2 ),Q b3 ) ^ 

H(R)+H(S) + H(T) < Jlogal-Fl - H(Ni) 



(79) 



(80) 



(81) 



From that, user 1 can obtain W 2 and W 3 . 

So, we have shown that conditions (|57|)-(|60|) are sufficient for reliable communication when H(Q) > H(T). 

Remark 11: The FDF-CS coding scheme proposed in this section is different from (i) FDF-IS and (ii) FDF-CS for H(Q) < 



H(T) (in Section VI-Ai, where at most two messages are sent simultaneously on the uplink. Here for the case where H(Q) > 
H(T), H{S) > H(P), and H(U) > H(R), three messages are sent simultaneously in the portion marked with *. Also, as 
H(Q) > H{T), this FDF-CS scheme does not reduce to FDF-IS. 

C. Combining the Results 

Combining the results in Sections VI-A and VI-B and Theorem [T] we have the following: 

Theorem 5 (Common cores): Consider the three-user finite field MWRC with correlated sources having common cores. A 
rate k > is achievable 

• [Converse] only if 

H(Wj,W k \Wi) < K [\og 2 \r\-max{H(No),H(Ni)}], (82) 

for all i, j, k £ {1,2, 3} where i ^ j ^ k; 

• [Achievability] if ([82) holds with a strict inequality for all i, j, k £ {1, 2, 3} where i ^ j ^ k. 

The structure of both the FDF-CS coding schemes is depicted in Fig. [6] The message component V is omitted because it 
is common to all users, and need not be transmitted. In the encoding operations shown in the figure, we have assigned user 1 
to transmit Q, user 2 to transmit £, and user 3 to transmit U. 
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Fig. 6. The FDF-CS channel coding 
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D. SW/FDF-IS can be Sub-Optimal 

We note that the rates achievable by SW/FDF-IS (derived in Theorem [2]i are also applicable to sources with common cores. 
Now, consider some sources with common cores, with unbalanced conditional mutual information, and without SCE, which 
have the following parameters: H(P) = 5, H(Q) = H(R) = H(T) = H{U) = 1, and H(S) = 3. The channel parameters 
are log 2 \T\ — H(No) — 7, and log 2 \ J- \ — H(Ni) = 10 for all i e {1,2,3}. From Theorem [5] all rates satisfying k > 1 are 
achievable. Recall that this setup is the same as that in Section V-B2| where we have shown that SW/FDF-IS fails to achieve 
the rate k = 1.05. So, SW/FDF-IS is strictly sub-optimal in this source and channel combination. 

The uplink transmission scheme that achieves the rate n = 1 + C f° r an Y C > 0, i.e., using the channel n = m(l + £) times 



to exchange m message triplets, is as follows (using the FDF-CS scheme from Section VI-A i 





m(l + C) uplink channel uses 


number of source bits 


3m 


2m 


n 


n 


user 1 transmits 


Pa 


Pc 


Q 




user 2 transmits 


s 






R 


user 3 transmits 






T 


U 



In the above scheme, user 1 transmits at i?i = 6/(1 + C) bits/channel use [6m bits per m(l + £) channel uses], user 2 
transmits at i? 2 = 4/(1 + £), and user 3 transmits at i?3 = 2/(1 + f). We see that using this scheme, constraint (|54]» imposed 
by SW/FDF-IS is violated when £ = 0.05. But this is fine using FDF-CS because it utilizes the common cores of the correlated 
messages — compare the channel coding schemes in Figs. [6] and [5] For example, in FDF-CS, the message components Q and 
T are transmitted simultaneously and only once on the uplink, and the relay forwards g(Q,T) — Q ®T. Since users 1 and 
2 both know Q, they can both decode T; user 3 knows T and can decode Q. 



21 



VII. Conclusion 

In this paper, we have obtained the set of all achievable rates for the following three-user finite field multi-way relay channels 
(MWRCs) with correlated sources: 

(i) For general source structures: two classes of source and channel combinations (more specifically, sources with almost 
balanced conditional mutual information and sources with skewed conditional entropies on symmetrical channels) 

(ii) For sources with common cores: all source and channel combinations 

For the first case, the rate region is obtained by Slepian-Wolf source coding and functional-decode-forward for independent 
sources (FDF-IS) channel coding (the combined scheme is denoted by SW/FDF-IS). As SW/FDF-IS is a separate source- 
channel coding scheme, we have incidentally shown that source-channel separation is optimal for the two classes of finite field 
MWRCs with correlated sources. For the second case, the rate region is obtained using our proposed functional-decode-forward 
for correlated sources (FDF-CS) coding schemes, constructed by extending the idea of functional decoding in FDF-IS. Source 
coding (if required) can also be performed independent of the channel codes. So, source-channel separation is also optimal for 
this case. 

To our knowledge, this is the first paper to derive achievable rates for MWRCs (with more than two users) with correlated 
sources. We have selected the three-user case and the finite field channel to demonstrate that the MWRC with correlated 
sources is not a straight-forward extension of (i) the two-user case, (ii) the MWRC with independent sources, or (iii) the 
noiseless MWRC with correlated sources. We have shown that for the three-user finite field MWRC with correlated sources, 
functional decoding proves to be optimal for sources with common cores, as well as two other classes of source and channel 
combinations. It remains a challenge how this coding strategy extends to MWRCs with more correlated users. 
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Appendix A 
Proof of Theorem 1 

Consider a general network of L nodes denoted by C = {1, 2, ... , L}, which is defined by the probability mass function 
p(Vi,U2, ■ ■ -,yL\xi,X2, ■ ■ -,x L ). Each node i e {1,2, .. . , L} has a length-m message W l = ( Wi [1] , Wi [2] , . . . ,Wi[m]), where 
Wi[t] € W 4 for all t. Each (Wi [t] , W 2 [t] , . . . , W L [i\) are i.i.d. according to p(w 1 ,w 2 , . • . , w L ), for all t e {1, 2, . . . , m}. Each 
node i transmits a length-n channel codeword X, = (JQ [1] , Xi [2] , . . . , X^[n]) where its transmitted symbol at time t, Xi[t], 
is a function of its message Wi and its previously received channel symbols ^[2], . . . ,Yi[t — 1]). 

We denote a set of variables {Ai : i € £>} by As- Now, we define a cut that separates the L nodes into two disjoint sets: 
S and S c = C\S. Assuming that all users in S c can cooperate, i.e., every user in S c has access to Ys° and W$c. If a user 
j G S c estimates W$ with probability of error Pen-on we must have 



mH{Ws\W s <) = H(W S \W S °) 

= I(W s ;YsAW S o) + H(Ws\Y s <, W s <) 
< I(W S ',Y&\Ws.) + H(P moi ) + P emi log 2 |Wg 
<I{W s ;Y s *\Ws<) + v 

n 

= E J (^i Y ^ M \ Y & W> • • • . Y s< [t - 1], w s . 

t=l 

n 

= E [ H fa w \ Y * W' • • • > [* - ^ w &) 

t=i 

-H(Y s *[t]\Y s *[l},..., Y s < [t-l],W s , W s * 

n 

= E [ H fa M | y ^ W ' • ■ ■ ' Y * [* - ^ ' w * ' x ^ W 

t=i 

- h (y S o [t] | y s * [i] , . . . , r S o [t - 1] , w s , w 5t , x 5 c [ t ] 

n 

<Y,[ H { Y ^ W | ^ M ) - # (rs. M I Vs. [i] , • • • , 
y s « [t - 1] , w s , w s < , x s . [t\ , x s [t 



(83a) 
(83b) 
(83c) 
(83d) 

(83e) 



E[ H ( ] M'l av./;) -//(». ./; .\>[/].a- 5 [/] 
t=i 



(83f) 

(83g) 

(83h) 
(83i) 
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= J2l{Xs[t};Y S c[t] X s *[t] 

t=l 

n 

= ^2l(x s [Q];Ys>[Q] Xs*[Q],Q = k 



k=i 



nl(Xs[Q};Ys°[Q] X Sc [Q],Q 



< n 



H (Y sc [Q] X SC [Q] ,Q)-H {Y s < [Q] X c [Q] , Q 
H {Ys° [Q] \x s *[Q], Q)-H (y s < [Q]\X C [Q] 
H (y s . [Q] J X s . [Q])-H (y s . [Q] J X c [Q] 



V, 



(83j) 

(83k) 

(831) 
(83m) 
(83n) 
(83o) 
(83p) 



= nI[X s [Q]]Ys*[Q] X S <[Q 

where H(P en - or ) = -P 2 \ogP enm - (1 - Penar) log 2 (l - fei™), V = H(P aTOI ) + mP elTor max, eS . |Ws<=|- Eqns. ([83b) and 
( |83e] > follow from the chain rule, ( |83c| > follows from Fano's inequality, ( |83f| l and ( |83m) > are by the definition of mutual 
information, ( |83g| l is because node i's transmitted channel symbol at time t, Xi[t], is a function of its past received symbols, 
("^[1], ■ ■ • ,Yi[t— 1]), and its message, W i, ( |83h| i and ( |83o| > are because conditioning can only reduce entropy, ( |83i| l and ( |83n[ ) 
are because the channel is memoryless such that the channel outputs at time t, Ys°, only depend on the inputs at time t, Xc\t\, 
( |83k[ ) follows from introducing a time-sharing random variable Q uniformly distributed on {1,2, ... ,n}. 

So, if any user j in the set S c is to reliably (i.e., with an arbitrarily small P er ror) decode the messages W$ from Y$c and 
Ws°, then the following must be satisfied for some p(xs), i.e., a necessary condition: 



mH(Ws\W s >) < nI{X s ;Y S c\X S c) 



(84) 



In the following application of the cut-set bound, each user j decodes the other messages using only its received channel 
outputs Yj and its own message Wj. This can be considered as one way of using the full information Ygc and Ws'> an d 
hence ([84) remains a necessary condition for reliable communication. 

Now, consider the three-user finite field MWRC with correlated sources. To apply the above cut-set results, we define the 
relay's message as a dummy Wq = 0. First, consider the cut separating {1,2} from {0,3}. User 3 can reliably decode 
(Wi,W 2 ) only if 

mH(Wi,W2\W Ql W 3 ) < nI(X 1 ,X 2 ;Y ,Y 3 \X Q ,X 3 ) (85a) 
= n[H (Y , Y 3 \X , X 3 ) - H(Y , Y 3 \X , X 1 ,X 2 ,X 3 )} (85b) 
= n[H{X x ®X 2 ® N , N 3 ) - H (N , N 3 )] (85c) 
= n[H{X 1 ®X 2 ® N ) + H(N 3 ) - H(N ) - H(N 3 )} (85d) 
= n[H {Xi © X 2 © JV ) - H(N )] , (85e) 

or equivalently, 

H(Wi, W 2 \W 3 ) < k[H(Xi ®X 2 ® Nq) - H(N )]. (86) 
Next, considering the cut separating {0, 1, 2} and {3}. Node 3 can reliably decode (Wo, W\, W 2 ) only if 

mH(W ,W 1 ,W 2 \W 3 )<nI(X 1 ,X 2 ,X ;Y 3 \X 3 ) (87a) 
= n[H(Y 3 \X 3 ) - HiY^X^X^Xs)] (87b) 
= n[H{X ®N 3 \X 3 )-H(N 3 )], (87c) 
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or equivalently, 

JT(Wi, W 2 \W 3 ) < k[H(X © N 3 \X 3 ) - H(N 3 )]. (88) 
Considering the cuts separating ({2, 3}, {0, 1}), ({0, 2, 3, }, {1}), node 1 can reliably decode (W 2 , W3) only if 

H(W 2 ,W 3 \W 1 ) < k[H{X 2 ®X 3 ® Nq) - H(N )} (89) 
H{W 2 ,W 3 \W 1 ) < K[ff(JC ©JVi|Jfi)-ff(iVi)] (90) 

respectively. 

Finally, considering the cuts separating ({1, 3}, {0, 2}, ({0, 1, 3, }, {2}), node 2 can reliably decode (Wi, W 3 ) only if 

H{W X ,W 3 \W 2 ) < k[H(X x ®X 3 (B N ) - H{N )} (91) 
H(W U W 3 \W 2 ) < k[H{X e A^ 2 |^ 2 ) - (JV 2 )] (92) 

respectively. 

If each user i is to reliably decode Wj and Wk for all k E {1,2,3} where i ^ j ^ k, the above conditions must 
be satisfied for some p(xo,xi,x 2 ,x 3 ). Note that H(N) are fixed for each MWRC and are independent of the channel 
inputs. Choosing independent and uniformly distributed X , X\, X 2 , and X 3 simultaneously maximizes the right-hand side 
of (|86|,(|88|)-(|92l). For this chosen distribution, the first entropy on the right-hand side of each of ([86|,((88])-(|92]) evaluates to 
H(-) = log 2 This gives Theorem[T] ■ 



